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THg pi * m nFRHiNcs tm f ^, m .~ n - Rr 

1. A method of creating a depth map including the steps of 

assigning a depth to a, (east one pixel or portion of an imag. 

^rsr: ima " — t- - a * 

uftaing said depth( 8 ), lma ge characteristics and respective 
to detune a configuration of a firs, algorfthm Ta^I ,„ t " 
charades as a Action o, relative ,oca 0 on and image characte^ 

wherein said depth character , 0 , m . d epth map lor sald , mage 
RGB valT* " C ' aimSd °' aim 1 ' Wher9,n " U ^ « include 



depth to mSth0d 85 °' aimed " C ' alm ' Whw ' ncludin 9 *• <* —**B a 
*P* to a„ y p, x9l or portion of said image (o ^ fw J^J"" 

« l^orr " C ' a,med e ' alm Where ' n Mld ima ° e delude 
least one of lummance. chrominance, contrast or spatial measurements. 



5 



.pJnteXlriT " ^ ~ ~ * **» - - 
where x and y define the relative location of a sample. 

LrnlT h rif S °' aim 1 ' Wh6rein 3 ,eamln9 a ' 90rithm iS ^ 

determine the configuration of said first algorithm. 

7- A method as claimed in claim 6, wherein for each pixel in the imaoe the 
learning algorithm computes: 9 ' 

Z„ B + k„.y n + ke.Rn + I^G* +k s .B„ 
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where 



n is the nth pixel in the key-frame image 
Zn is the value of the depth assigned to the pixel at x. y n 
ka to k. are constants and are determined by the algorithm 
Rn la the value of the Red component of the pixel at x„ y n 
On <s the value of the Green component of the pixel at x,y n 
B n « the value of the Blue component of the pixel at x„,y n 

ZJ S 27"*TV 'T m 7 ' wh9r9in said 

•nones pixels having s.milar characteristics to a known pixel. 

In a^rir^ in " ,ft M "* ' ^ - - 

'Lizi: ~ in ° ,aim — ■ - — • — — - 

claimed risim 1 -i . .. 

a pixel is determined 



13. A method as claimed claim 1 1 . wherein the depth of 
by a weighted average of distances from similar pixels. 



11 * A m ?° d ^ C ' aimed C ' aim 13> Wherein we, '9 hts ™ ■nverse.y 
proportioned to distance. y 

LionJT " C ' a ' mBd **" * Wherei0 98Ch *— «■* b divided or 

~:cr of re9iona and a aep,h — >— - - — 



9. AUG. 2001 1 5:21 WERMARK PATENT 6 1 3 981 9601 0 W" NO. 5173 — P. 26/33 




25 



1 6. A method of creating a depth map including the steps of ■ 

assigning a depth to at least one pixel or portion of an image; 
determining x.y coordinates and image characteristics for each said at 
least one pixel or portion of said image; 

to *e JIT! T, ima9S Cha ~ te3 «* x.V coordinates 

coordinates and image characteristics; 

utilising said first algorithm to calculate a depth characteristic for each pixel 
or portion of said Image; p 

wherein said depth characteristics form a depth map for sa j d image. 

Inlde^Tvalr C ' aimed °' alm 16 ' ^ *~ 

<L„ , A ^ " Cla,m9d ° laim 16 ' Urther in0Mnfl * e ** °< ^9*0 a 
depth to any pixel or porlion „ said image , 0 ^ for ^ 

i* A m".r? r c,aim 16, wherein ,ma ° e °— 

measure!,! ' nan ° e ' " °' -«" 



20. a method as Calmed in claim 16, wherein said flrs, algorithm may be 
represented by the equation: 
z = f(x,y,R,G,B) 
where x and y define the relative location of a sample. 

dlr * "T* aS °' ai,,,9<: ' 10 °' alm 16 ' WherBin 8 teamin9 a, 9° ri,hm is <c 
determine the configuration of said first algorithm. 

» A method as claimed in claim 21, wherein for each pixel in the image, the 
learning algorithm computes: 

Zr. . k,.x„ + k„.y„ + kc.R„ + kj.Gn +k,.B„ 

where 
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n is the nth pfxel in the key-frame Image 
2n is the value of the depth assigned to the pixel at x„ y n 
ka to are constants and are determined by the algorithm 
R„ is the value of the Red component of the pixel at x„ y„ 
G n >s the value of the Green component of the pixel at x n y 
B n .s the value of the Blue component of the pixel at x,y n " " 

23. A method as claimed in claim 21 who^i*, ~ 

introduced tnth.1 • " a random component is 

•ntroduced to the learning algorithm to reduce over-training. 

24- A method as claimed in Calm 23. wherein said random component is a 
small positive or negative random number. ™ponent » a 

'denies p,xels having similar characteristics to a known pixel. 



~°:r a,med ,n o,aim 25 ' wherein ^ — - — - - 



26. 

within a search radius. 



2 L ir:r ciaimed ,n c,aim 2e ' ~ - -* — — - 

28 A matted as claimed in of claim 25, wherein the depth of a pixel Is 
ds.erm.nedbxaweioh.edaverageofdls.anoesfromeimllarpixels. 

29. A method as claimed in claim 28, wherein weights are inverselv 
proportioned to distance. inversely 



oLo A r H ° d 98 °' a ' med ' n ° lalm Whereln eac " '"^eristic is divided or 

»t::~ r - ,e9ms and a ^ — *- - - 
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3 ^zz::r in9 a ^ - ^ -» - - *- «— 

receiving « depth map for a. km one frame of « image sequ9nce . 

a seconTlT 9 ^ " d8P ' h *° dS ' em ™ a — " «W»< °' 

,ocat„!? '° d9P ' h *"—"— - a function o, reiative 

location and image characteristics; 

ee q uen U r n9 "' B0 * ,m * "~ * ^ *" fra ™ °< *■»«• 

32. A method as claimed in claim 31, wherein at lea* two depth maps 
corroding to a, leas, two frames of said image sequence are received 

, 3 nciude A " Claim8a ^ 31 ' SaW lmaoe characteristics 

"«lude a, leas, one o, luminance, chrominance, centres, or s P a,,a, 
measurements. *pa«ai 

llrmlTT 7 °' aimed " ° laim 31 ' Wher8,n 3 feanlina a '°°™<" * <° 
determine the configuration of said second algorithm. 



36 A method as Calmed in claim 35, wherein said learning algorithm is one of 
back propagation algorithm. C4.5 algorithm, or K-means aigorithm. 

37. A method as claimed in claim 35, wherein said second algorithm 
computes: 

2n = ka-Xn + k b .y n + kc.R„ + k^G,, +k e .B„ 

where 

n is the nth pixel in the key-frame image 
z n is the value of the depth assigned to the pixel at x^y, 
k. to ke are constants and are determined by the algorithm 
Rn is the value of the Red component of the pixel at *, y n 
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Gn is the value of me Green component of the pixel at x„ y„ 
Bn is the value of the Blue component of the pixel at 

38. A method as claimed in claim 31, wherein additional aigorlthm 

receiving a depth map for a, leas, one frame of said image sequence; 

^' S ZZT* one deplh map ,o detem * e a —» ' ~ « 

s~ d al90 * hm '° Crea ' e 3 dSP,h * "* *"» - « ^ 

40. A method as claimed In claim 39, wherein at leas, two depth maps 
corresponding to a, leas, two frames of said , mafle sequence are rece^. 

mciude A a.T!T " in °' aim 39 ' Wherel " Mid ima9e ^racteristics 

Mud. a, .east one of luminance, chrominance, contrast or spatial 

measurements. 

de'termfneTT 1 * * a » h utilised to 

determine the configuration of said second algorithm. 

back propagate algorithm. C4.5 algorithm, or K-means algorithm. 
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l P l method 35 claimed in c,a,m wh8rei " saM ~»* ~» 

^ ■ k..x„ + k B .y„ + Ml, + M3„ 

where 

n is the nth pixel in the key-frame Image 

Is the value of the depth assigned to the pixel at x,,y„ 
k. to K. are constants and are determined by the algorithm 
H, « the value of the Red component of the pixel at x„ y 
G " 13 *• value °< Green component of the pixel a. xjy„ 
B„ is the value of the Blue component of the pixel at x„,y„ 

<6 A method as claimed in claim 39, wherein additional algorithm 

hrrr:::r ,9aforBachpa,rof ^'— 

receiving depth maps for a, leas, two key frames of said image sequence- 

depth oharaotenste as a function of x,y coordinates and image characteristics- 
u^tng said algorithm tocreate a depth map of each fie of sad mat 

::z:rr ,rames adiacan ' saw ^ *- - ~ ~ 

p'Lsir^ a ; c ' aimed in ciaim 4A wherein — - -y «*» >s 

HTSht; ^^ a ° 8nlkey,ra ™ iS,h ~— V^eforcreatlonof 

lpu,es me,h ° d M ""J * * °' 47 ' -»* - —nd algorithm 

Z„ = ka.X n + k b .y n + (Jr,, + kd Gn +|<e Bf) + kf T 

where: 

n is the nth pixel in \h\ image 
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zn is the value of the fepth assigned to the pixel at x n y n 

ka to k f are constants pUously determined by the algorithm 

Ro is the value of the Rekcomponent of the pixel at x„y n 

G„ -s the value of the GreeVcomponent of the pixel at x n y n 

Bo is the value of the Blue component of the pixel at x n y 0 " 

T is a measurement of time, fo\thie particufar frame in the sequence 



50 A method of cr9atjrlg a se . es of depfh ^ 

including the steps of: sequence 

selecting at least one key frame from said image sequence- 
Pcrtlontr fir °" 9 * frame 3 *»> * " - *■ or 

determining relative location and Image characteristics for each said at 
least one pixel or portion of each said key frame- 

utilising said depthfs). image characteristics and respective relative 

! i or ,T said at ,easi ° ne ,rame ,o * *■* 

as a function of relative location and depth characteristics- 

utilising said first algorithm to calculate depth characteristics for each pixel 
or portion of each said at least one key frame- 

one keytl" ^ 3 ^ ** ~* - - - 

utilising each depth map to determine a second configuration of a second 
s^nthm to ascertain the depth characteristics for each frame as a funcC 
relative location and image characteristics; 

utilising said second algorithm to create respective depth maps for each 
frame of said image sequence. 

a™ ord!^ " ^ * ""^ " a ™ S adjaC °"' -« ^ *»"- 
are processed prior to non-adjacent frames. 

» A method as claimed in claim 51, wherein following processing ad/acen« 
frames are considered as key frames for further processing. 
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S3. A method or encoding . series of frames inc| , ra 

™PP,n g function together wW , ^ frames , where|n ^ 9 - 

•no. des an a , fl oH.h m ,o ascertain depth character as a (unc L of rela ™ 
location and image characteristics. 

TgB valT 0 ' ^ da ' m °' a " n <8 ' Wh8rein MW ^ ^de 

Lde A rr," C ' aimed C ' aim 53 ' Wh9r6in ~" '™ 9e ""stics 
■nclude at teas, one of luminance, chrominance, contrast or spatial 
measurements spatial 



dlrmfneTr M T Cb,m ^ WherSin 9 learni " 9 ° l9 °™ m * «— »° 
aetermine said mapping function. 



57. 




A method as claimed in claim 56, wherein said learning algorithm is one of 
back propagation algorithm, C4.5 algorithm, or K-means algorithm 

z 0 = k a .x n + k b .y n + kc.R„ + k„.G n +k e .B n 

where 

n is the nth pixel in the key-frame image 
zn is the value of the depth assigned to the pixel at x n ,y n 
ka to ke are constants and are determined by the algorithm 
Rn is the value of the Red component of the pixel at x n y n 
G„ Is the value of the Green component of the pixel at x„ y n 
B n is the value of the Blue component of the pixel at x^' 

59. A method as claimed in claim 53, wherein additional algorithms are 
created for each pair of frames for which depth maps have been received. 



